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Abstract 


estlmtlon  algorlthai  Is  proposed  and  evaluated  for  on-line  filtering  of  an  Image 
scanned  In  a raster  pattern.  This  algorithm  combines  a least  squares  parameter 
Identification  procedure  with  a two-dimensional  reduced  update  Kalman  filter. 

Results  using  an  Image  with  a 3 dB  signal  to  noise  ratio  Indicate  that  this  adaptive 
algorithm  Is  very  effective  for  Image  restoration. 


1 .  INTROOUaiON 

Olgital  processing  of  Images  has  in  recent  years 
became  both  economical  and  practical.  Most  sophis- 
ticated Image  processing  Is  performed  off-line  on 
large  machines  because  of  the  large  menory  and  com- 
putational requlreaents  of  the  largely  used  non- 
recurslve  methods.  In  particular  for  the  Image 
estimation  problem,  classical  nonrecurslve  techniques 
Involve  operations  with  large  matrices  and  their 
inverses  and  are  hence  not  suitable  for  real-time 
applications  which  might  Include: 

1.  Restoration  of  noisy  Images  after  reception 
on  a low  power  transmission  link. 

2.  Pictures  arising  from  low  light  level  Imaging 
where  background  sensor  noise  significantly 
contributes  to  the  output  signal. 

3.  Reception  of  a decoded  OPCM  Image  which  re- 
sults from  a max1mum-11ke11hood  decoding 
technique. 

4.  Processing  of  non-image  two-dimensional  (2-0) 
data  for  noise  reduction  prior  to  display  In 
Image  format. 


The  use  of  digital  computers  for  Image  estimation 
P®P“’4*‘ly  called  Image  restoration 
classical  method  due 
to  Helstrom  [Ij  was  presented  In  1967.  Many  varla- 
original  method  were  proposed  [2], 
[3J,  [4].  However  they  all  shared  the  need  for 
manipulating  laroe  arrays  with  the  attendant  need 
for  large  general  purpose  computers. 


•This  research  sponsored  by  the  Air  Force  Office  of 
Scientific  Research,  Air  Force  Systems  Command, 
USAF,  under  Grant  No.  77-3361.  The  United  States 
Government  Is  authorized  to  reproduce  and  distri- 
bute reprints  for  Governmental  purposes  not  with- 
standing any  copyright  notation  hereon. 


More  recently  various  recursive  algorithms  have 
been  derived  which  permit  a more  efficient  realiza- 
tion [5],  [8]. 

The  methods  discussed  In  [5]  and  [6l  are  however 
recursive  In  only  one  direction  and  therefore  do 
not  fully  attain  the  efficiency  of  true  2-0  recur- 
sive processing,  where  the  recursion  Is  In  both 
dimensions.  In  [7]  a method  Is  presented  for  such 
recursive  processing  for  scalar  observations  from 
a raster  scan  of  a 2-0  data  set.  Recent  results 
however  [9],  point  out  errors  In  the  derivation  In 
[7]  casting  doubt  on  the  validity  of  the  entire 
method. 

More  recently  Woods  and  Radewan  [10]  have  proposed 
the  r(>duced  update  Kalman  filter  as  a means  for 
alleviating  the  computational  problems  which  had 
precluded  the  Implementation  of  2-0  estimation 
algorithms.  This  filter  was  shown  to  be  optimum 
In  the  sense  of  minimizing  the  post  update  mean 
square  error  subject  to  the  constraint  of  updating 
only  the  "nearby"  previously  processed  picture 
elements. 

It  should  be  noted  however  that  the  reduced  update 
Kalman  filter  and  other  proposed  pixel  estimation 
procedures  require  an  autoregressive  type  model 
whose  coefficients  must  be  determined  from  some 
available  set  of  similar  images  [11].  Since  such 
sample  images  are  not  always  available  and  since 
images  In  general  are  nonstationary  and  not  neces- 
sarily true  autoregressive  processes.  It  Is  inter- 
esting to  consider  the  implementation  of  an 
apaptive  2-0  estimator.  Such  an  adaotlve  estimator 
(analogous  to  an  adaptive  controller)  would  consist 
of  an  identification  algorithm  which  calibrates  the 
picture  model  coefficients  used  by  the  Kalman 
estimator.  One  such  configuration  recently  pro- 
posed by  Keshavan  and  Srinath  combines  the  Identi- 
fication of  a 2-0  Interpolative  model  with  a sub- 
optimal  estimation  algorithm  [12].  Although  their 
resulting  Image  enhancmeent  was  rather  Impressive, 
their  proposed  procedure  does  not  appear  suitable 
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. $(«,n)  • £*V,(«,n)  ♦ *i(«,n),  (11) 

wMrt  Is  tilt  portion  of  tho  stato  voctor  i in 

tHo  todal's  tctlvo  oMMry,  i.#.,  tlw  psaudo-stato 
vactor  [10]. 

laagas  art.  In  ganaral.  non-hoMoganaous  and  hanca 
tha  almnts  of  c art  spatially  variant.  Idaally. 
tlwn-,  a c vactor  should  ba  found  for  tach  pixal 
(■.n). 

Thus  at  salactad  Intarvals  an  astlaata  c for  tha 
coafficlant  vactor  at  point  (a.n)  wy  bo  datanalnad 
so  as  to  alnlalza  tha  ganaral  wolghtad  laast  squarss 
Indax: 


A K K 

•Cf.,  (1.J)  r(1.J)]. 

As  a variant  to  halp  raduca  tha  off acts  of  bias, 
tha  aaasursMnt  nolsa  varlanca  tlaas  tha  unit 
aatrix  ms  subtracted  fro*  tho  first  suantlon 
prior  to  Invarslon. 

3.  Fixad  oMMory,  ganaral  least  squares. fit.  l.a., 
K(l.J*.«,n)  • 1. 


(rOj)  - c7r,(i,J))2.  d(1,jys.n) 

02) 

uh^a  ^ Is  the  vactor  of  naasuranents  (from  eq. 
(2))  of^Sj  andJl  Is  the  data  history  over 
which  the  Index  iS’to  ba  alnlMlzed  at  point  (a.n). 


•^  a.n  ■ « « region  slallar  In  fora  to 

shown  In  Floura  1b].  Tha  awory  Is  said  to 
w^f  order  (lxL)  If  tha  martiarad  pixels  to  tha 
left,  right,  and  above  pixel  (a.n)  Is  equal  to 
L.  Because  of  probleeis  Inherent  to  the  davalop- 
aant  of  a recursive  lapleaentatlon.  a non- 
recurslva  algorltha  was  used. 


andW(1.J;a.n)  Is  a fading  aaanry  weighting  factor.  aaaory  least  squares  fit.  l.o.. 


Tha  varlanca  of  tha  plant  noise  (w(a.n)  of  (1])ms 
estimated  using: 


ff^(a.n)  ■ jp— 

cjr,0.j))^ 


(r(1.J)  - 


03) 


idiara  Is  tha  nuebor  of  points  in  the  data 

■'  • • ■‘^justmant  constant  chosen 

eaplrlcally  to  account  for  che  error  In  using  r and 
r,  rather  than  s and  i,.  Although  minimization  of 

02)  Is  kiiM  to  yield  biased  estimates  It  was 
felt  that  In  view  of  earlier  work  [13].  such  an 
^proach  might  yield  accapUbla  results.  Present 
effortt  are  howavar  being  davotad  to  the  study  of 
tec^quM,  such  as  that  proposed  by  Kotob  and 
KaufMn  [14].  which  taka  Into  account  tha  bias 
cMsad  by  the  Interaction  of  tho  noise  In  both  r 
and  r,. 


For  purposes  of  comparison,  tha  following  identi- 
fication algorithms  ware  tasted: 


M(l.J;m.n)  ■ exp(-o|m-1 |-o|n-j|)  . 

J*»m.n  **“  •*  «»«  3 order  to 

simplify  computation. 

4.  EXPERIMENTAL  PROCEDURES 

T^  noise  free  Image  as  shown  In  Figure  2.  Is  a 
. * / ^"*9*  data  field.  Additive  maasuremant 
noise  w(m.n)  was  simulated  using  a Gaussian  white 
noise  generating  subroutine.  For  simulation  pur- 
poses. a 3 db  signal  to  noise  ratio  ms  used,  with 
nom  varlanca  equal  to  1442  giving  the  picture 
shown  In  Fig.  3.  These  parameter  values  and  as- 
sociated plant  noise  Mre  passed  on  to  the  reduced 
update  ICaiMn  filter.  From  previous  experiments, 
the  raquIradOt^  ***4  regions  Mre  chosen  as 

Pl9"  4.  Boundary  conditions  for  eqns. 
(7).  (8).  and  (9)  ware  assumed  to  be 
diagonal  while  those  for  (5)  and  (6)  were  assumed 
to  be  zero.  Though  the  parameter  and  gain  values 
were  changed  across  the  boundary  of  each  block  In 
tte  filter,  no  detectable  edge  effects  Mre  noM 
In  the  estimated  Image. 


1.  Infinite  memory,  general  least  squares,  i.i 
U(1.jjm.n)-1.  A-.-  [1.j|l<1<m,  1<1<N-1 
J.«.  l<l<m.O. 

RocursTve  updates  were  used. 


2.  Infinite  memory,  general  least  squares  fit 
over  distinct  square  block  se^nents  of  the 
picture  of  dlimlon  KxK.  I.e..  M(1.jye.n)-1, 
Am.ii  * Cl>J|lfJc  selected  block] 


In  this  cate  the  estimate  ms  computed  after 
receipt  of  the  entire  biMk  by: 


The  estimated  Image  ms  then  compared  with  the 
'Mise-free  data,  and  evaluation  ms  based  upon 
the  estimation  Index » 

J I {*(<.J)  - s(i.j))2  (15) 

wheM  t(1.J)  Is  the  true  pixel  Intensity  and  s(1.J) 
^<*.[«luced  update  estimate  based  upon  the 
Identified  model  and  71,1s  the  total  number  of 
pixels.  Also  considered  ms  the  Identification 
residual  Index, 

(»•(".")  - e'’(m.h)r,(m.n))2  (16) 

computed  at  point  (l.j)  for  c. 
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, V S.  RESULTS 

# 

Initially  In  ordtr  to  tvaluato  tfio  various  Idanti* 
’ ficatlon  algorlthas  only  tMo  (32  x 32)  blocks  In 
tha  ■otttb'ChIn  aroa  of  Fig.  3 Mara  procassad.  Ra- 
sults  suMorlzad  In  Tabla  1 shOM  that: 

0 Alt  algorltisB  raducod  tha  astiMtIon 
"varlanca*  J wall  balow  tha  obsarvatlon 
nolsa  varlanca  of  1442. 

0 Infinite  MBory  racursiva  least  squares 
Is  not  satisfactory  bacausa  of  tha  non> 
stationary  nature  of  tha  laage. 

0 A data  history  of  order  larger  than  (3  x 3) 

Is  naodad  to  reduce  tha  affects  of  Masura- 
nant  noise. 


Other  exparlaents  (not  su 
showed  that: 


irizad  In  Table  1) 


0 A 10-20S  laprovaaent  resulted  froa  using  a 
(2  X 2)^  order  o^el  with  12  coefficients 
rather  than  tha  (1  x 1)*"  order  nodal. 

0 Estinatlon  results  (J)  could  be  Improved 
significantly  (303)  In  many  casas  by  using 
a saallar  value  for  (Eq.  13).  Tha  adjust- 
ment factor  Y was  found  maplrlcally  to  be 

0.3  for  all  cases. 


Comparison  of  Fig.  S,  which  corresponds  to  an  In- 
finite nwnory  Identification,  with  Fig.  6,  which 
corresponds  to  block  processing,  shows  the  need 
for  a finite  manory  size  If  rapidly  changing  de- 
tails (I.e.,  teeth)  are  to  be  processed. 


Algorithm 

memory-re- 

cursive 

least 

squares 


— IM— Ml 


Table  1 Processing  Results  Using  a (1  x1}th 
Order  Modal  Over  2 (32  x 32)  Blocks 


6.  CONauSION 

Basedupon  the  preceding  results.  It  can  be  con- 
cluded that  a fixed  mamory  least  squares  parameter 
Identifier  used  for  adaptation  of  the  model  In  a 
reduced  update  two-dimensional  Kalman  filter  Is 
very  effective  for  Image  recovery.  Under  study  at 
the  present  time  are  efforts  directed  towards: 

. Removing  the  bias  In  the  parameter  estimates. 

. The  study  of  simultaneous  parameter  and  pixel 
estimation  (e.g.,  via  axtended  Kalman  filter 
and/or  quastllnaarlzatlon). 

. Implementation  of  a fixed  memory  filter 
through  the  use  of  a stochastic  dynamic 
parameter  model . 
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Fig*  1 Specifications  of  Usad  to 

Otfliw  Updated  Regions 


Fig.  5 Results  Using  an  Infinite  NaMry 


Fig.  6 Results  Using  Block  Processing 
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